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DELTA  PULSE  CODE  MODULATION  COMPRESSION 
RELATIVE  TO  STEREO  IMAGE  MATCHING 

The  growing  trend  of  collecting  images  in  digital  form  and  the  associated  requirement 
of  processing  the  images  interactively  means  that  compression  techniques  will  probably 
be  employed  to  facilitate  image  transfer  among  image  sensors  and 

INTRODUCTION  PcnP*iera*.s  a,ul  to  *ess^n  1 ll<-'  storage  burden  on  image  processors. 

^ This  report  presents  an  evaluation  of  the  effect  of  compression  on 
one  image  processing  function,  namely  stereo  image  matching.  The 
work  is  a continuation  of  a compression  study  that  was  reported  on  in  a previous  ETL 
Research  Note.1  In  that  Research  Note,  there  was  no  information  loss  in  the  com- 
pression described,  and  consequently,  there  could  be  no  adverse  effect  on  image 
registration. 


Delta  Pulse  Code  Modulation  (DPC'M)  with  optimum  quantization  or  gray  shade 
differences  was  the  technique  used  to  compress  the  imagery,  and  conventional  corre- 
lation methods  were  used  to  determine  the  effect  of  compression 
on  image  matching.  The  effect  of  compression  on  image  match- 
METHOD  mg  was  determined  by  noting  the  decrease  in  match  precision  as 

the  level  of  compression  increased. 


GENERAL 


The  15  digitized  stereo  scene  pairs  used  in  this  work  were  extracted  from  the  Digital 
Image  Analysis  lab  (DIAL)  system.2  The  scenes  are  displayed  in  appendix  A along 
with  specific  digitizing  information.  Each  scene  was  125  by  125 
Experimental  pixels.  The  scenes  are  placed  in  order  by  REC01  signal  power,  that 

Data  is,  the  signal  power  of  scene  1 was  larger  than  the  signal  power 

of  scene  2,  and  so  on.  RHCOl  is  the  DIAL  label  for  the  first  of  the  two  digitized 
stereo  images. 

Compression  was  achieved  by  quantizing  the  gray  shade  differences  derived  from 
DPCM.  The  differences  are  derived  by  predicting  a gray  shade  at  the  source  and  then 
sending  the  difference  between  the  actual  gray  shade  and  the 
Compression  predicted  value.  Differences  are  generally  more  independent  than 

are  the  gray  shades  and  their  band  width  is  less  than  the  gray  shade 
band  width.  As  a result,  these  characteristics  provide  for  more  efficient  data  coding. 
The  first  step  then  is  to  determine  a worthwhile  linear  predictor,  and  the  next  step 
is  to  derive  an  efficient  quantization  rule  for  an  assigned  number  of  bits  per  pixel. 

Linear  Generally,  a specific  gray  shade  is  predicted  by  a linear  combination 

Predictor  of  prior  gray  shades,  or  prior  gray  shade  estimates  as  in  DPCM. 

The  method  of  computing  trial  linear  predictors  is  described  in 


1 Michael  A.  Crombic,  Ermrfree  Compression  of  Digital  Imagery,  U.S.  Army  Engineer  Topographic  Laboratories, 
tort  Belvoir.  VA.  KTL-0079.  November  1976,  A0-AO33  272. 

^L.  Cambino.  B.  Schrock  “An  Experimental  Digital  interactive  Facility," Computer,  Vol.10,  No. 8.  Aug.  1977,  p.22-28. 
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appendix  B.  It  was  assumed  that  the  first  line  and  the  first  column  of  gray  shades  of 
each  scene  were  stored  along  with  the  quantized  differences.  Since  the  coefficients  of 
the  several  trial  linear  predictors  were  derived  by  least  squares,  the  mean  squared  error 
will  be  used  to  evaluate  the  predictors. 

From  the  results  shown  in  appendix  B,  a marked  improvement  in  performance  can  be 
observed  for  higher  order  predictors  as  the  scene  signal  power  increases.  However  there 
is  not  much  improvement  to  be  gained  in  using  fourth  order  predictors  over  third 
order  predictors.  In  fact,  there  is  not  much  improvement  to  be  gained  in  using  third 
order  predictors  over  second  order  predictors  for  low  signal  power.  Rather  than  com- 
plicate the  work  by  varying  the  order  of  the  predictor  according  to  signal  power,  the 
third  order  predictor  was  used  throughout.  Note  that  specific  third  order  coefficients 
were  used  for  each  of  the  30  scenes. 

Quantization  The  digitized  gray  shades  for  the  30  scenes  were  represented  by 
256  levels  (8  bits).  The  quantized  gray  shade  differences  were 
represented  in  turn  by  1 to  6 bits.  The  numerical  procedure  for 
determining  the  6 X 30  = 180  quantization  rules  is  described  in  appendix  C.  In  every 
case,  the  differences  were  derived  by  the  pertinent  third  order  linear  predictor  de- 
rived in  appendix  B. 

DPCM  Assume  that  (ai(3i  T)  are  the  third  order  predictor  coefficients. 

The  quantity  go  q is  defined  as  the  predicted  value  of  gQ  o where 
c/o  is  any  one  of  the  gray  shades  not  in  the  first  row  or  first 
column. 

90,0  = “ * 9o.-l  + 6 * 9-1,0  + Y * 


9 : Regenerated  gray  shades 

l\,  L 

( K, L ) : Line  and  pixel  indices 

If  go  0 is  the  predicted  value  of  go  Q then  d = gQ  _ go  is  the  difference  and  d is 
the  quantized  difference.  Finally,  the  regenerated  gray  shade  is 

9o,o  =-50,o  + d 

Since  the  quantized  difference  d is  inexact,  the  regenerated  gray  shade  will  be 
in  error.  The  amount  of  error  is  directly  related  to  the  number  of  bits  assigned  to 
represent  the  true  difference  d.  The  error  is  given  by  the  following  equation: 
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Average  errors  and  standard  errors  of  e for  six  scenes  are  presented  in  appendix  C. 
Both  the  average  errors  and  the  standard  errors  decrease  as  the  signal  power  decreases 
and  as  the  number  of  bits  assigned  to  d increases  (see  tables  C5  and  C6). 

It  is  difficult  to  determine  from  the  tabulated  results  of  appendix  C just  what  the 
adverse  effect  of  a specific  quantization  rule  is  on  an  intended  use  of  the  imagery. 

The  object  of  this  work  was  to  determine  the  adverse  effect  of 
compression  on  stereo  matching.  This  objective  was  accomplished 
by  comparing  compressed  match  results  to  8-bit  match  results. 

A 9 by  9 rectangular  grid  of  points  was  designated  on  each  of  the  15  RECOl  scenes, 
and  their  corresponding  points  on  the  15  REC02  scenes  were  determined  by  conven- 
tional correlation  methods.  The  defined  points  in  the  RECOl  scenes  were  spaced  10 
pixels  and  10  lines  apart.  A match  point  was  estimated  on  the  REC02  scene,  and  an 
11  by  11  correlation  function  was  generated  about  the  estimate.  The  line  and  pixel 
location  of  the  correlation  maximum  was  computed  and  designated  as  the  match  point. 
Note  that  the  correlation  function  was  computed  at  integer  pixel  and  line  intersections; 
whereas,  the  match  point  was  computed  to  fractions  of  line  and  pixel  values.  This 
correla.ion  function  was  calculated  for  each  of  the  9X9  = 81  defined  points.  Four 
different  window  sizes  were  used  to  generate  the  correlation  functions. 


Image 

Matching 


Window  Size  (Pixels) 
7 x 7 
11  x 11 
17  x 17 
21  x 21 


Ground  Dimension  (Feet) 
24  x 24 
40  x 40 
64  x 64 
80  x 80 


Several  precautions  were  taken  to  decrease  the  possibility  of  incorrect  matches  from 
procedure  rather  than  from  compression.  The  precautions  along  with  a summary  of 
match  results  are  presented  in  appendix  D. 

The  object  of  the  numerical  tests  was  to  calculate  the  effect  of  one  type  of  data  com- 
pression, namely  DPC'M,  on  a specific  photogrammetric  function,  that  is.  stereo  image 
matching.  The  parameters  of  DPC'M  and  the  parameters  of  the  K-bit 
DISCUSSION  quantization  rule  were  adapted  to  local  scene  characteristics.  Thus. 

the  process  should  be  near  optimum  in  the  type  of  compression  and 
in  the  specific  imagery. 

Four  estimates  of  each  of  the  81  match  points  for  the  15  scene  pairs  were  computed 
using  the  six  K-bit  quantized  images  and  using  the  full  8-bit  images.  The  four  estimates 
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pertain  to  the  tour  window  sizes.  Weighted  averages  of  the  match  points  were  com- 
puted; the  procedure  is  described  in  appendix  I). 

X I S K * Y ISK 

I = ] , 81  points 

S = 1 , 15  scene  pairs 

K = 1 , 6 and  8 bits. 

Table  1 shows  the  internal  pre- 
cision of  the  four  estimates  for  six 
of  the  scenes  and  for  the  several 
K-bit  images.  The  internal  pre- 
cision is  simply  the  standard  — 
deviation  in  pixel  spacing  of  the  ' 75 

individual  estimates  (according  1.42 

to  window  size)  with  respect  to 
the  weighted  averages.  The  first  2 55 

entry  is  the  standard  deviation  1.62 

in  X,  and  the  second  is  the  stan- 
dard deviation  in  Y.  The  scenes  3 .57 

were  organized  according  to  signal  1.6O 
power;  scene  1 had  the  largest 
signal  power  and  scene  15,  the  4 55 

least.  1 58 

In  table  1 , the  internal  precision  5 -56  1.03  .71  .97  1.25  1.24 

does  not  appear  to  vary  as  the  1.53  i . 62  .54  i.36  1.21  1.39 

number  of  bits  K increases  or  as 

signal  power  varies.  The  table  6 55  .96  . 76  .85  1.23  1.33 

does  show  that  the  internal  pre-  1.57  1.59  .54  1.14  1.25  1.39 

cision  in  Y is  less  than  (i.e.  its 

standard  error  is  larger)  the  inter-  8 54  1 - 03  74  87  '-'9  '-21 

nal  precision  in  X.  This  is  not  un-  1.53  1.60  .53  1.16  1.22  1.39 

expected  since  the  major  parallax 
direction  is  along  the  image  Y-axis. 

In  any  case,  the  consistency  of  the  internal  precision  over  K and  over  signal  power 
provided  justification  for  comparing  the  K-bit  weighted  estimates  to  the  8-bit  weighted 
estimates  as  a means  for  evaluating  the  K-bit  compression. 

f lic  method  for  calculating  the  comparative  results  is  described  in  appendix  D,  and 
results  for  six  of  the  scenes  are  presented  in  tables  D3  and  1)4.  In  table  1)3.  the  DPC'M 
compression  does  not  introduce  a bias  between  K-bit  and  8-bit  match  results. 


Tabic  I . Internal  Precision 

SCENE 


3 

6 

9 

13 

15 

1.03 

.76 

1.07 

1.55 

1.40 

1.74 

.47 

1.39 

1.43 

1.64 

.93 

.73 

.92 

1.28 

1.26 

1.59 

.60 

1.19 

1.34 

1.34 

1.13 

.81 

.96 

1.18 

1.14 

1.65 

.53 

1.22 

1.12 

1.27 

.97 

.77 

.88 

1.27 

1.25 

1.53 

.54 

1.11 

1.28 

1.38 

7 


In  tabic  1)4,  the  standard  error  of  the  discrepancies  between  K-bit  and  8-bit  match 
results  decreases  as  k increases.  Also  in  table  1)4,  the  standard  error  of  discrepancy 
does  not  vary'  as  signal  power  varies.  Since  most  of  the  information  used  in  the  correla- 
tion process  is  derived  from  the  lower  frequencies,  the  compression  process  functions 
like  a low  pass  filter.  For  this  reason,  the  results  for  the  set  of  1 5 scenes  were  combined 
to  produce  table  2. 

The  units  in  table  2 are  pixel  spa-  Tabic  2.  weighted  Avenges  of  o8K 


cings.  The  quantity  a is  a combined 

Bn 

c« 

oy 

„ 

estimate  of  the  standard  error  of 
discrepancy  in  X and  Y. 

1-8 

0.  554 

0.758 

0.664 

2-8 

0.487 

0.466 

0.476 

The  entries  in  table  2 pertain  to 

3-8 

0.265 

0.313 

0.290 

standard  errors  of  mismatch  between 

4-8 

0.222 

0. 189 

0.206 

k-bit  images  and  8-bit  images.  For 

5-8 

0.  171 

0.178 

0.  174 

example,  the  standard  error  between 
match  results  of  8-bit  images  and  1-bit 

6-8 

0.150 

0. 149 

0.150 

images  is  about  two  thirds  of  a pixel  spacing  in 

each  coordinate. 

The  standard 

error  is 

reduced  to  less  than  one  fifth  of  a pixel  spacing  as  k is  increased  to  6 bits. 

The  average  number  of  bits  per  pixel  can  be  reduced  by  efficient  coding  of  the  quan- 
tized differences,  such  as  in  Huffman  coding.3  If  the  average  number  of  bits  per  pixel 
must  be  reduced  to  a small  fraction  of  a bit.  then  either  line  and  pixel  thinning  must  be 
applied  to  the  image  before  DPCM  or  transform  coding  methods  must  be  employed. 
However,  if  the  image  processing  facility  can  accommodate  one  or  two  bits  per  pixel, 
then  DPCM  will  provide  images  that  do  not  create  a bias  in  stereo  image  matching,  so 
that  the  standard  error  of  mismatch  between  original  results  and  results  derived  from 
compressed  data  is  less  than  two  thirds  of  a pixel  in  each  coordinate. 

1.  The  third  order  linear  predictors  are  sufficiently  precise  for 
DPCM  when  applied  to  aerial  imagery. 

CONCLUSIONS  2.  The  DPCM  compression  does  not  introduce  a bias  in  stereo 
matching. 

3.  The  standard  error  of  mismatch  for  images  compressed  to  one  bit 
per  pixel  by  DPCM  compared  to  fully  resolved  images  is  approximately  two  thirds  of 
a pixel  spacing  for  each  coordinate. 


3Michacl  A.  Crombie,  Errorfree  Compression  of  Digital  Imagery.  U.S.  Army  Engineer  Topographic  Laboratories, 
l-ort  Belvoir,  VA.  ETl-0079,  Nov  1976,  AD-AQ33  272. 
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Al’I’l  M)1X  A.  DICilTI/l  I)  SCI  Ml  S 


I iltceii  digitized  stereo  scenes  were  extracted  from  the  DIAL  system  lor  the  com- 
pression analysis.  1 lie  15  scene  pairs  are  subsets  of  a larger  scene  that  was  scanned  on 
the  I’DS  I050A  Automatic  Microdensitometer  system. 'The  pixel  spacing  and  the  line 
spacing  was  24  ipn  (micrometers),  the  pixel  diameter  was  34.5  t|m,  and  256  gray 
shades  (X  hits)  were  used  to  represent  the  image  density. 

Hie  left  image  is  referred  to  as  RICO 1 and  the  right  image  is  referred  to  as  RLC02. 
The  RhCOl  image  scenes  given  below  are  photographic  reproductions  extracted  from 
the  DIAL  COM TAL  display.  The  central  portion  of  each  scene  was  used  in  the  com- 
pression study. 

Figure  Al.  Tbi  Scenes  1.2,3.  and  4. 


’Michael  A.  Crombie,  Stereo  Analysis  of  a Specific  Digital  Model  Sampled  from  Aerial  Imagery 
necr  Topographic  Laboratories,  Fort  Betvoir,  VA.,  I TL-0072,  September  1 976.  AD-A033  567. 
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APPENDIX  B,  LINEAR  PREDICTORS 


Assume  that  the  first  line  of  an  N2  digital  image  is  stored  along  with  the  first  gray 
shade  of  each  succeeding  line.  The  remaining  (N-l )-  gray  shades  will  be  represented  by 
coded  differences.  The  difference  dy  for  i and  j >1  is  the  difference  between  the  actual 
gray  shade  gy  and  a predicted  value  gy. 

9jP  = ^ ak  9k 

The  subscript  p pertains  to  any  one  of  the  2<(ij)<N  locations,  and  k pertains  to  one 
of  the  K predictor  coefficients.  The  coefficients  are  chosen  so  that  the  mean  square 
error  S is  minimized.  c * ,2 

S-2J9P'ak9k> 

P 

P=  1,  P = (N  - l)2 

The  least  squares  solution  for  thea^  becomes  a function  of  the  digital  image  auto- 
correlation function.  Five  linear  predictors  are  described  next. 

The  following  matrix  represents  the  fifth  order  normalized  autocorrelation  function. 


1 

R0I 

R02 

**03 

R04 

R05 

RI0 

Rt. 

RI2 

RI3 

RI4 

R15 

R=  R20 

R2I 

R22 

R23 

R24 

R25 

R30 

R3I 

R32 

R33 

R34 

R35 

R40 

R4, 

R42 

R43 

R44 

R45 

RS0 

R5 1 

R52 

RS3 

R54 

R55 

The  (l,m)tri  entry  of  R represents  the  normalized  correlation  between  gray  shades 
that  are  lagged  (1  - i ) rows  and  (m  - i ) columns.  The  normalization  was  achieved  by 
dividing  each  element  of  the  autocorrelation  by  T^,  where  T00  is  the  image  variance. 

In  what  follows,  let  gQ  Q represent  the  gray  shade  in  question,  i.e.  any  one  of  the 
(N  - 1 )“  values  to  be  estimated. 

First  Order-Row 

Assume  that  gOQis  to  be  estimated  by  the  proceeding  gray  shade  in  the  same  line. 


9 = a a _ i 

o.  o 3o  1 


a = R 

o 1 

S = 1 - R 2 

o 1 


The  symbol  S represents  the  normalized  theoretical  mean  square  error.  The  mean 
square  error  in  all  cases  is 


,2  = S 


T 

oo 


First  Order  - Column 

Assume  that  ga  Q is  to  be  estimated  by  the  proceeding  gray  shade  in  the  same 

column.  q = B q. , „ 

0,0 

8 = Rio 

s ■ i - 

Second  Order 


Assume  that  gQ  Q is  to  be  estimated  by  the  proceeding  gray  shade  in  the  same  row 
and  by  the  proceeding  gray  shade  in  the  same  column. 


Third  Order 

Assume  that  gQ  Q is  to  be  estimated  by  the  same  gray  shades  used  in  the  second 
order  linear  predictor,  plus  the  proceeding  diagonal  gray  shade  of  the  previous  line. 


•1 
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Fourth  Order 


Assume  that  yQ  0 is  to  be  estimated  by  the  same  gray  shades  used  in  the  third  order 
predictor,  plus  the  succeeding  diagonal  gray  shade  of  the  previous  line.  Note  that  the 
last  gray  shade  of  each  line  cannot  be  estimated  with  this  predictor. 


S = 1 - a Rui  - 8 Riu  " Y Rii  - 6 Rii 


Results  from  6 of  the  15  scenes  were  compiled  and  are  presented  in  the  following 
tables.  The  columns  labeled  d pertain  to  the  average  difference,  o~  pertains  to  the 
theoretical  variances,  and  ss~  pertains  to  the  computed  variances  of  the  differences. 
A difference  is  simply  d = 90  0 * flQ  Q.  the  difference  between  the  actual  gray  shade 
and  the  estimated  gray  shade. 


15 
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TABLE  61  Prediction  Results  of  Scene  i 
RECOT 


Order  of 
Predictor 

0 

t 

_S_ 

t 

x 

2 

_0 

2 

SS 

1st  (col) 

.81 

29 

342 

333 

1st  (row) 

.91 

14 

iei 

182 

2nd 

.28 

.69 

5 

151 

126 

3rd 

.47 

.77 

.28 

6 

141 

93 

4th 

.47 

.53 

.18 

.20 

-.2 

121 

104 

Autocorrelation 

Functior 

* 1006 

1.00 

.91 

.75 

.61 

.52 

.44 

.81 

.77 

.66 

.53 

.44 

.37 

.50 

.50 

.42 

.33 

.24 

.17 

.32 

.34 

.29 

.21 

.13 

.06 

.35 

.36 

.33 

.28 

.21 

.13 

.50 

.52 

.51 

.47 

.41 

.33 

REC02 

Order  of 
Predictor 

a 

6 

_r_ 

( 

1 

2 

0 

2 

SS~ 

1st  (col) 

.81 

32 

297 

298 

1st  (row) 

.91 

15 

148 

157 

2nd 

.27 

.70 

5 

131 

114 

3rd 

.44 

.77 

.25 

6 

122 

90 

4th 

.43 

.56 

.16 

.18 

-.2 

113 

97 

Autocorrelation  Function 

1.00 

.81 

.51 

.33 

.34 

.48 

.91 

.77 

.51 

.36 

.38 

.53 

v 2 , 

.75 

.66 

.45 

.32 

.36 

.52 

T°c  ■ 872 

.61 

.54 

.36 

.25 

.30 

.47 

.50 

.43 

.25 

.15 

.21 

.40 

.41 

.35 

.17 

.06 

.12 

.32 
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TABLE  82  Prediction  Results  of  Scene  3 
RECOT 


Order  of 
Predictor 

0 

e 

_1_ 

( 

2 

0 

2 

ss 

1st  (col ) 

.81 

27 

301 

302 

1st  (row) 

.90 

14 

169 

171 

2nd 

.31 

.67 

3 

133 

121 

3rd 

.61 

.81 

-.46 

c 

107 

75 

4th 

.62 

.68 

-.42 

.12 

0 

97 

79 

AutOCOrre 

latior 

Func 

tior 

1.00 

.81 

53 

.42 

.52 

73 

.90 

.75 

49 

.38 

.47 

68 

VO 

00 

00 

M 

7* 

O 

O 

.75 

.63 

40 

.29 

.39 

60 

.65 

.54 

32 

.22 

.32 

54 

.62 

.51 

25 

.19 

.29 

51 

.61 

. 50 

28 

.17 

/ *» 

REC02 

Order  of 

Predictor 

a 

e 

_2_ 

( 

d 

2 

C 

ss' 

1st  (col) 

.78 

32 

331 

329 

1st  (row) 

.90 

14 

161 

167 

2nd 

.26 

.71 

4 

127 

130 

3rd 

.54 

.81 

-.39 

6 

no 

98 

4th 

.54 

.70 

-.36 

.11 

1 

no 

98 

Autocorrelation 

Function 

1.00 

.78 

.48 

.35 

45 

.66 

.90 

.73 

.46 

.34 

44 

.64 

cn 

VI 

00 

N 

>4 

O 

O 

.76 

.63 

.39 

.28 

38 

.58 

.66 

.54 

.31 

.21 

30 

.50 

.60 

.49 

.26 

.14 

24 

.45 

.57 

.46 

.22 

.10 

19 

.41 
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TABLE  E3  Prediction  Results  of  Scene  f 


RECOT 


Order  or 
Predictor 

0 

e 

_1_ 

i 

x 

0 

ss 

1st  (col) 

.93 

12 

80 

87 

1st  (row) 

.91 

16 

110 

102 

2nd 

.58 

.41 

2 

56 

54 

3rd 

.76 

.67 

-.45 

3 

43 

40 

4th 

.75 

.49 

-.39 

.14 

1 

43 

40 

Autocorrelation 

Function 

1.00 

.93 

.82 

.73 

.67 

63 

.91 

.86 

.78 

.71 

.66 

63 

Too*  * 613 

.74 

.73 

.68 

.64 

.61 

59 

.60 

.59 

.57 

.56 

.54 

53 

.49 

.49 

.48 

.48 

.47 

47 

.42 

'.41 

.41 

.41 

.41 

REC02 

Orde^  ot 

2 

2 

Predictor 

0 

t 

l 

d 

c 

SS 

1st  (col) 

.91 

16 

91 

90 

1st  (row) 

.89 

20 

111 

101 

2nd 

.55 

.43 

4 

61 

55 

3rd 

.71 

.63 

-.37 

5 

50 

43 

4th 

.70 

.42 

-.30 

.18 

1 

50 

44 

Autocorrelation  Function 

1.00 

.91 

.76 

.66  .59 

.55 

.86 

.83 

.72 

.64  .58 

.54 

„ 2 

.69 

.67 

.61 

.56  .53 

.50 

Teo  ■ 507 

.52 

.51 

.49 

.47  .45 

.44 

.41 

.40 

.38 

.38  .37 

.37 

.32 

.31 

.30 

.30  .30 

.30 
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TABLE  B4  Prediction  Results  of  Scene  9 


RE  COT 


Order  of 
Predictor 

a 

t 

< 

2 

0 

2 

ss 

1st  (col) 

.88 

23 

82 

82 

1st  (row) 

.90 

19 

72 

72 

2nd 

.44 

.54 

5 

49 

46 

3rd 

.57 

.64 

-.25 

7 

49 

40 

4th 

.56 

.41 

-.18 

.21 

1 

45 

41 

i 

tutOCQr 

relation 

Function 

1.00 

88 

.71 

.61 

54 

50 

.90 

83 

.70 

.60 

54 

49 

Toe  * 376 

.75 

73 

.65 

.58 

53 

43 

.65 

64 

.60 

.55 

52 

47 

.59 

59 

.56 

.53 

50 

46 

55 

55 

.53 

61 

AO 

re 

REC02 

Orde^  of 

2 

2 

Predictor 

0 

t 

d 

c 

SS 

1st  (col) 

.79 

42 

126 

122 

1st  (row) 

.86 

29 

92 

89 

2nd 

.36 

.59 

9 

72 

65 

3rd 

.50 

.68 

-.24 

12 

64 

59 

4th 

.49 

.57 

-.21 

.12 

6 

64 

59 

Autocorrelation  Functior 

1.00 

.79 

.58 

.48 

43 

.40 

_ 2 

.86 

.73 

.57 

.48 

43 

.40 

Too  * 340 

.68 

.62 

.52 

.46 

42 

.39 

.56 

.53 

.47 

.44 

41 

.38 

.49 

.47 

.43 

.42 

40 

.38 

.46 

.44 

.42 

.40 

38 

.36 

19 


TAELE  E.  Prediction  Results  of  Scene  13 


PEC  01 


Order  of 
Predictor 

a 

e 

_X_ 

i 

J_ 

2 

c 

2 

ss 

1st  (col) 

.83 

29 

73 

70 

1st  (row) 

.88 

22 

54 

59 

2nd 

.39 

.57 

6 

39 

40 

3rd 

.54 

.68 

-.27 

8 

37 

37 

4th 

.53 

.56 

-.24 

.12 

4 

37 

3( 

Auto 

correlatior  Fun: 

tipr 

1.00 

.83 

.65 

.54 

.47 

42 

v 2 

.88 

.77 

.64 

.54 

.48 

43 

■»°c  * 235 

.71 

.66 

.59 

.52 

.47 

43 

.60 

.57 

.54 

.50 

.46 

43 

.52 

.51 

.49 

.48 

.46 

43 

.46 

. '*6 

.46 

.46 

.45 

44 

REC02 

Order  of 

2 

Predictor 

0 

t 

_ 

X. 

d 

C 

2 

SS 

1st  (col) 

.76 

44 

93 

95 

1st  (row) 

.80 

36 

80 

83 

2nd 

.40 

.54 

12 

61 

59 

3rd 

.50 

.61 

20 

15 

59 

56 

4th 

.49 

.51 

_ 

17 

13 

9 

57 

55 

Autocorrelation  Function 

1.00 

.76 

.53 

.42 

36 

.32 

2 

.80 

.67 

.51 

.41 

35 

.30 

*ee  ■ 227 

.61 

.56 

.47 

.39 

33 

.28 

.49 

.46 

.41 

.37 

32 

.27 

.41 

.39 

.37 

.35 

31 

.27 

.36 

.35 

.34 

.33 

31 

.27 

table 

86 

Prediction 

Results 

0^ 

Scene 

Jr 

REC01 

Order  of 

Predictor 

0 

t 

-X. 

e 

J_ 

2 

0 

2 

SS 

1st  (col) 

.85 

27 

35 

36 

1st  (row) 

.86 

25 

33 

33 

2nd 

.46 

.50 

7 

23 

21 

3rd 

.57 

.60 

-.23 

9 

21 

20 

4th 

.56 

.43 

-.18 

.18 

3 

20 

20 

Autocorrelation 

Function 

1.00 

.85 

.67 

.56 

.48 

.43 

. 2 

.86 

.78 

.65 

.55 

.49 

.44 

ioo  * 129 

.68 

.66 

.59 

.53 

.48 

.45 

.54 

.54 

.52 

.49 

.47 

.45 

.45 

.46 

.45 

.45 

.45 

.44 

.35 

.3? 

. 40 

,41 

.42 

.42 

EEC  02 

Order  of 

Predictor 

a 

t 

d 

2 

c 

2 

SS 

1st  (col) 

.73 

52 

59 

60 

1st  (row) 

.78 

43 

50 

49 

2nd 

.40 

.52 

14 

37 

37 

3rd 

.52 

.61 

-.22 

17 

35 

35 

4th 

.51 

.53 

-.21 

.10 

12 

35 

34 

Autocorrelation  Function 


feo  ■ 125 


APPENDIX  C.  QUANTIZATION  RULE 


Assume  that  any  one  of  the  prediction  schemes  of  appendix  B produced  a set  of 
differences  { dj  : j - t , (N  - i )- } and  that  it  is  required  that  the  set  be  compressed 
by  quantization  methods.  The  set  ot  differences  will  be  represented  by  a finite  number 
of  ditterence  levels  qj  ,qi...  .qm  which  will  reduce  the  number  of  bits  needed  to  des- 
cribe the  set  and  at  the  same  time  will  allow  for  a reasonably  accurate  reconstruction 

ot  the  original  image.  Let  dj,  di d|n+|  represent  the  interval  boundaries  for  the 

M-quantized  differences.  Determine  the  set  of  q values  and  the  set  of  d values  so  that 
the  mean  squared  error  of  the  quantization  is  minimized. 


M d i + 1 


■Ef 


S = | ( d - q . )2  pr (d )dd 


d,- 


pr(d)  is  the  probability  of  the  occurrence  of 
difference  d. 


The  solution1  is  given  by  the  following  expressions: 


d,-  = 


(qiM  + Pi  )/2 

■d, 


i = 2,3,. ..,M 


J- 


+ 1 

pr(d  )dd 


q,  = 


i = 1,2, ...M 


I 


l + l 

pr(d  )dd 


J.  Max.  “Quantizing  for  Minimum  Distortion,"  IRK  Transactions  Information  Theory.  V.  IT-6,  1960. 
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An  iterative  numerical  solution  described  by  Rosenfeld2  was  used  to  determine  the 
q values  and  the  d values.  A sample  density  function  was  constructed  from  the  set 
of  differences,  and  the  trapezoidal  rule  was  used  for  numerical  integration.  Note  that 
u I and  dm+j  are  known;  they  are  the  largest  and  smallest  of  the  set  of  differences. 

A set  of  q values,  a set  of  d values,  and  a set  of  relative  frequency  values  were  esti- 
mated for  each  of  the  30  scenes  (15  stereo  pairs)  and  for  bit  assignments  ranging  from 
one  bit  to  six  bits.  Each  of  the  6 * 30  = 180  quantization  rules  pertain  to  differences 
derived  from  third  order  predictors.  The  relative  frequency  data  pertains  to  the  proba- 
bility density  distribution  of  the  differences  over  the  quantization  intervals.  A repre- 
sentative quantization  rule  for  the  first  four  bit  assignments  was  derived  by  averaging 
over  the  15  scenes.  These  results  are  presented  below.  Note  that  the  pertinent  rule  was 
used  in  the  compression  analysis,  not  the  averaged  rule.  The  expected  value  of  Q is 

computed  from  £ QP(Q);  note  that  the  quantized  differences  are  positively  biased. 

TABLE  Cl Average  Quantization  Rule  for  1 Bit 


RECC1  REC02 


2 

P 

2 

C 

P 

-00 

4.33 

-0.67 

.4530 

6.18 

2.36 

4414 

♦03 

9.33 

.5470 

+00 

13.99 

cccc 

E(Q)  = 

4.80 

E (Q)  = 8.86 

TAS.E  C2 

Average  Quar. 

tizatior 

Rule  for  2 Bits 

RECOi 

RECC2 

Z 

s 

P 

7 

L 

fl 

p 

1 

o 

o 

-00 

-2.31 

-6.43 

.1253 

0.47 

-4.29 

.1225 

4.79 

1.81 

.3613 

8.65 

5.22 

.3445 

11.29 

7.76 

. 3753 

16.13 

12.07 

.3820 

+00 

14.81 

.1381 

+00 

20.18 

.1510 

E(Q) 

= 4.81 

E(Q)  = 8.93 

^A.  Roscnfeld.  Digital  Picture  Processing.  Academic  Press.  New  York.  San  Irancisco,  London.  1976.  pc  102. 
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TABLE  i 3 Average  Quantization  Rule  for  3 Bits 


REC01 

REC02 

z 

9 

P 

Z 

9 

P 

-00 

-00 

-7.94 

-11.61 

.0356 

-6.48 

-10.68 

.0302 

-1.92 

-4.27 

.1086 

0.45 

-2.29 

.0970 

2.23 

0.42 

.1807 

5.38 

3.20 

.1751 

5.71 

4.03 

.2292 

9.49 

7.56 

.2266 

9.11 

7.38 

.2079 

13.42 

11.42 

.2176 

12.92 

10.08 

.1457 

17.81 

15.41 

.1550 

18.24 

15.02 

.0677 

23.91 

20.22 

.0775 

+00 

21.47 

.0246 

+00 

27.61 

.0208 

E(Q)  = 4.67 

E(Q)  = 8.75 
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TABLE  C4  Average  Quantization  Rule  for  4 Bits 


REC01 

REC02 

z 

s 

P 

Z 

fi 

P 

-00 

• 

-00 

11.24 

-14.62 

.0178 

-11.03 

-15.03 

.0119 

-5.68 

-7.85 

.0532 

-4.57 

-7.03 

.0378 

-’.89 

-3.51 

.0942 

-0.29 

-2.11 

.0686 

1.02 

-0.28 

.1285 

2.99 

1.53 

.0991 

3.46 

2.33 

.1426 

5.71 

4.44 

.1186 

5.60 

4.59 

.1369 

8.11 

6.98 

.1268 

7.52 

6.60 

.1112 

10.29 

9.24 

.1297 

9.33 

8.45 

.0936 

12.37 

11.34 

.1071 

11.08 

10.22 

.0710 

14.38 

13.39 

.0888 

12.82 

11.94 

.0517 

16.42 

15.37 

.0712 

14.63 

13.69 

.0374 

18.57 

17.47 

.0448 

16.58 

15.57 

.0242 

20.86 

19.67 

.0406 

18.74 

17.60 

.0157 

23.43 

22.06 

.0303 

21.31 

19.88 

.0088 

26.40 

24.80 

.0147 

24.68 

22.74 

.0060 

30.06 

28.01 

.0077 

+00 

26.63 

.0040 

+00 

32.11 

.0056 

E(Q)  = 4.35 

E(Q)  - 

8.68 

L 


j 


The  quantities  £ and  °|  in  tables  C'5  and  C <>  are  the  average  error  and  standard 
error  of  gray  shades  regenerated  from  the  specific  quantization  process.  The  first  entry 
in  each  set  pertains  to  RECOl,  and  the  second  entry  pertains  to  RK  02  Results  from 
6 of  the  15  scenes  are  presented.  The  errors  are  defined  by  the  following  relation 


dj  : Quantized  difference 


,g  : Regenerated  gray  shades 
g^  0 : Correct  gray  shade 


j = 1,6  Quantization  Rules 

TABLE  C5  Average  Quantization  Errors 
Scene 


Bit 

#1 

#3 

*6 

*9 

#13 

*15 

1 

.79 

.52 

.18 

.09 

-.05 

-.32 

.97 

.42 

.44 

-.01 

-.37 

-.11 

2 

.08 

.03 

-.10 

-.03 

-.11 

-.13 

-.07 

-.11 

-.12 

-.06 

-.05 

-.05 

3 

-.02 

-.08 

-.05 

-.09 

-.11 

-.09 

-.03 

-.05 

-.05 

-.10 

-.08 

-.12 

4 

-.03 

-.06 

-.08 

-.04 

-.05 

-.06 

-.05 

-.05 

-.07 

.01 

-.02 

r^- 

o 

i 

5 

-.02 

-.04 

.09 

-.04 

.49 

-.10 

-.03 

.05 

-.06 

.02 

-.05 

-.06 

6 

-.01 

-.03 

-.08 

-.05 

-.02 

-.07 

-.03 

.00 

-.07 

.00 

-.05 

t 

o 

-nI 

TARGET  C6  Standard  Error  of  Quantization  Errors 
Scene 


Bit 

#1 

#3 

#6 

#9 

#13 

*15 

1 

10.95 

8.57 

7.78 

7.15 

6.34 

4.69 

10.70 

9.43 

7.62 

8.16 

7.05 

5.01 

2 

4.41 

3.38 

3.26 

3.16 

3.51 

2.40 

4.08 

4.51 

3.05 

4.61 

4.05 

2.68 

3 

2.20 

1.74 

1.73 

1.78 

2.18 

1.22 

1.98 

2.82 

1.53 

1.64 

2.71 

1.60 

4 

1.33 

1.07 

1.41 

0.93 

1.31 

1.16 

1.15 

2.17 

1.08 

1.75 

2.27 

1.20 

5 

0.91 

1.03 

1.68 

1.02 

2.90 

1.06 

0.79 

2.09 

1.02 

1.51 

2.02 

1.17 

6 

0.75 

0.90 

1.27 

0.83 

1.00 

0.90 

0.85 

1.85 

1.00 

1.04 

1.86 

1.07 
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APPENDIX  D.  MATCH  RESULTS 


Numerical  results  from  the  match  procedure  described  in  the  General  Method  section 
are  presented  in  this  appendix.  Average  match  results  are  presented  in  tables  D!  and 
1)2  below  for  six  scenes  and  for  1-  to  8-bit  images.  An  attempt  was  made  to  match  81 
points  in  each  scene  using  21  by  21,  17  by  17,  II  by  11,  and  7 by  7 windows.  The 
first  row  of  four  values  in  each  set  are  averages  of  successful  match  correlation  values. 
The  second  row  of  four  values  in  each  set  are  averages  of  a confidence  measure  that 
is  defined  below.  Finally,  the  third  row  of  four  values  in  each  set  are  the  numbers  of 
successful  matches.  The  four  values  pertain  to  the  four  window  sizes,  namely  21  by 
21,  17  by  17,  1 1 by  1 1.  and  7 by  7,  in  order. 

The  confidence  measure  is  the  product  of  the  two  partial  derivatives  of  the  corre- 
lation function  with  respect  to  x and  y respectively.  Both  of  these  values  must  be 
negative  for  the  correlation  function  to  be  concaved  downward.  If  either  of  the  partial 
derivatives  were  positive,  the  match  point  was  rejected.  If  a computed  shift  was  larger 
than  one  in  abloslute  value,  then  that  match  point  was  rejected.  The  product  of  the 
two  partial  derivatives  is  regarded  as  a confidence  measure  in  that  large  values  indicate 
a narrow,  well  defined  correlation  function;  whereas,  small  values  indicate  a flatter 
less  well  defined  correlation  function. 
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A linear  combination  of  the  four  or  less  match  point  estimates  was  computed  for 
each  point. 


XI,S  = Wj  XIJS 

J=1 

4 

"l,S  = WJ  YIJS 

4 J=1 

W = 1 

J=1  J 

I = 1 , 81  points 
S = 1 , 15  scenes 
J = 1 , 4 Window  Sizes 


Numerical  values  were  assigned  to  the  Wj  according  to  window  dimension;  larger 
windows  were  assigned  larger  weights.  Although  the  smaller  windows  usually  produced 
higher  correlation  values  and  sharper  peaks  than  the  larger  windows,  the  likelihood  of 
a false  peak  is  also  higher.  Suppose,  for  example,  that  all  four  estimates  of  a particular 
point  were  acceptable.  The  weights  in  this  case  would  be 


21  x 21  : W2  = 21-Vp  = 0.49000 

17  x 17  : W2  = 1 7 2 / P = 0.32112 

11  x 11  : Wj  = 1 1 2/P  = 0.13444 

7x7  : W4  = 72/P  = 0.05444 

P = 21 2 + 17'  + 11 2 + 72  = 900 
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The  same  weight  definition  applies  to  the  four  situations  where  three  of  the  estimates 
are  considered  successful.  Any  point  with  two  or  fewer  successful  matches  was  ignored. 


The  weighted  estimates  for  the  1-  to  6-bit  images  were  compared  in  tum  to  the  8- 
bit  image-weighted  estimates.  The  average  difference  and  the  standard  error  of  the 
difference  were  calculated  for  comparison. 

81 

CXK8S  = f v X I S K ' XIS8J 

1 = 1 

£1 

°XK8S  = -rrr  [(XiSK  ^ISs)  ' EXK8S]" 
i = i 

K = 1 , 6 bits 
S = 1 , 1 5 scenes 
I = 1 , 81  points 


A similar  pair  of  equations  were  evaluated  for  the  Y measurements.  The  value  L is 
less  than  or  equal  to  81 ; the  value  is  the  number  of  points  that  are  represented  by  va- 
lid estimates  from  both  8-bit  and  K-bit  matches.  Results  for  six  scenes  are  presented  in 
tables  D3  and  D4.  In  table  D3,  DPCM  compression  does  not  cause  a bias  between  K- 
bit  image  match  results  and  8-bit  image  match  results.  In  table  D4,  the  standard  error 
of  the  discrepancies  between  K-bit  image  matches  and  8-bit  matches  decreases  as  K 
increases.  Note  the  units  of  the  tabular  entries  in  both  tables  are  pixel  spacings. 
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TABLE  D3 


Standard  Error  of  Discrepancies  Between  k Bit  Matches  and  D-Bit  Matches 
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T ABLE  IV4  Average  Discrepant  Between  K-Bit  Matches  and  8-Bit  Matches 
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